Bayesian partitioning for classi cation and regressionC
نویسندگان
چکیده
In this paper we propose a new Bayesian approach to data modelling. The Bayesian partition model constructs arbitrarily complex regression and classiication surfaces over the design space by splitting the space into an unknown number of disjoint regions. Within each region the data is assumed to be exchangeable and to come from some simple distribution. Using conjugate priors the marginal likelihoods of the models can be obtained analytically for any proposed partitioning of the space where the number and location of the regions is assumed unknown a priori. Markov chain Monte Carlo simulation techniques are used to obtain distributions on partition structures and by averaging across samples smooth prediction surfaces are formed.
منابع مشابه
Bayesian Classi cation
Bayesian classi cation addresses the classi cation problem by learning the distribution of instances given di erent class values. We review the basic notion of Bayesian classi cation, describe in some detail the naive Bayesian classi er, and brie y discuss some extensions. C5.1.5.
متن کاملClassi cation using Bayesian Neural Nets
Recently, Bayesian methods have been proposed for neural networks to solve regression and classi cation problems. These methods claim to overcome some di culties encountered in the standard approach such as over tting. However, an implementation of the full Bayesian approach to neural networks as suggested in the literature applied to classi cation problems is not easy. In fact we are not aware...
متن کاملProbabilistic Models for Bacterial Taxonomy
We give a survey of di erent probabilistic partitioning methods that have been applied to bacterial taxonomy. We introduce a theoretical framework, which makes it possible to treat the various models in a uni ed way. The key concepts of our approach are prediction and storing of microbiological information in a Bayesian forecasting setting. We show that there is a close connection between class...
متن کاملAdjusted Probability Naive Bayesian Induction
Naive Bayesian classi ers utilise a simple mathematical model for induction. While it is known that the assumptions on which this model is based are frequently violated, the predictive accuracy obtained in discriminate classi cation tasks is surprisingly competitive in comparison to more complex induction techniques. Adjusted probability naive Bayesian induction adds a simple extension to the n...
متن کاملBinary Feature Selection with Conditional Mutual Information
In a context of classi cation, we propose to use conditional mutual information to select a family of binary features which are individually discriminating and weakly dependent. We show that on a task of image classi cation, despite its simplicity, a naive Bayesian classi er based on features selected with this Conditional Mutual Information Maximization (CMIM) criterion performs as well as a c...
متن کامل